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ABSTRACT 

A Cuyahoga County (Ohio) project developed a 
multiagency, comprehensive basic skills improvement system designed 
to increase the employability of people receiving public assistance r 
out-of -school youth, and Job Training Partnership Act (JTPA) clients* 
An advisory committee composed of individuals representing the 
collaborative groups was established to guide the activities and 
ensure all collaborators were informed and involved. At least 400 
intake workers and employment counselors participated in a 90-minute 
training session. Although an initial objective was to upgrade the 
county JTPA testing system so that test results in reading and math 
would be more meaningful with regard to client placement , it became 
clear that it would be practical to have as many agencies as possible 
using a common testing tool. Recommendations were to find an 
acceptable r not perfect test? decide upon "passing levels"; develop a 
referral process? and develop a client tracking process. 
Recommendations with respect to referral were the importance of 
orientation, communication ^ and linkage with all agencies. Classroom 
training programs at the fourth- to eighth-grade levels in writing 
and mathematics were found to be more effective when students were 
subdivided into separate and distinct classes by levels of ability. 
Other recommendations for training were use of computer-assisted 
instruction and nontraditional teaching methods. (YLB) 
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FINAL REPORT 



LITERACY AT WORK: 
A MULTI-AGENCY COLLABORATIVE PROJECT 



INTRODUCTION 

In July, 1989 the Cuyahoga County Department of Development was awarded 
a grant by the Ohio Department of Education's Office of Job Training 
Partnership Services. This final report Is Intended as a summary of what was 
learned as a result of that grant. This report does not Include many of the 
details attendant to program Implementation and operations, but rather focuses 
on the broader lessons learned throughout the course of the project. It Is 
our hope that others embarking on similar projects might benefit from our 
experiences. Specific materials pertinent to the project are available 
through the Cuyahoga County Department of Development's Learning Center. 

One out of five adults In Greater Cleveland is functionally illiterate. 
This situation has led to a plethora of economic, social and individual 
problems, not the least of which has been the effect of illiteracy on 
employment potential. The goal of this project, therefore was to develop a 
multi-agency, comprehensive basic skills Improvement system designed to 
Increase the "employability" of those receiving public assistance, 
out-of-school youth and Job Training Partnership Act (J.T.P.A.) clients. 
Because public agencies and educators were reporting difficulties in 
recruiting and serving Individuals at the lower end of the literacy continuum, 
special emphasis was placed on recruiting and developing programs for this 
population. 

The project was a cooperative one that Initially included as 
collaborators the Cuyahoga County Department of Development, which encompasses 
both the Office of Employment and Training and the Learning Center; the 
Cleveland Heights - University Heights Adult Basic Education (ABE) Program; 
the Cuyahoga County Private Industry Council; the Cuyahoga County Department 
of Human Services' Fair Work Program; the Greater Cleveland Literacy 
Coalition; and the Regional Office of the Ohio Bureau of Employment Services 
(OBES). Later, other public agencies and non-profit organizations became 
Involved in the project. The majority of the project was "housed" at the 
County's J.T.P.A. Learning Center. 



ERIC 



3030 Euclid Avenue 
Room 2 

Cleveland. Ohio 44115 
216-987-4911 



Literacy at Work: A Multi-Agency Collaborative Project 
Page Two 



The objectives of the grant, briefly stated, were to: establish an 
active advisory committee; train government employees, but particularly Intake 
workers and employment counselors (both hereafter referred to as "workers"), 
on Issues relevant to Illiteracy and educational program resources available 
to clients; upgrade the literacy testing system; establish an effective 
recruitment and referral system, with emphasis on the lower level reader; and 
develop "segue" writing and math programs for the lower level (I.e., 4th to 
8th) reader. 

It should be noted at. the outset that during the course of this grant 
project first a pilot Fair Work Program and then the JOBS Program were 

Implemented In Cuyahoga County. Thus, we are able to report not only on the 

grant objectives, but also what we learned as the project expanded to Include 

JOBS clients. 



THE PROJECT ADVISORY COMMimE 

The project's Advisory Comnlttee was established to guide the activities 
of the grant and to ensure that all key collaborators were both Informed and 
Involved. The Committee was composed of Individuals representing the 
collaborative groups. (Please refer to the Introduction for a list of these 
agencies.) The Advisory Committee met prior to the start-up of grant 
activities and thereafter at approximately six-week Intervals. 

There are several recommendations that we would make with regard to such 
a committee. First, the importance of all parties being represented from the 
outset should not be underestimated. Prior to any activity beginning, each 
collaborator brought Information about his or her programs and needs, as well 
as thoughts about the Impact of this project on operations. From the outset, 
then, expectations and barriers were clear, and very little arose between the 
collaborators that came as an unwanted surprise. An added benefit of this 
broad-based group was that we found Issues outside the purview of the grant 
being discussed and resolved, as the Committee provided a forum for discussion 
that did not previously exist. In fact, we found the Interactions of this 
group to be so helpful that the decision was made to continue meeting after 
the expiration of the grant. 

To make expectations clear and to ensure that a project remains on 
track, we recommend that committees prepare and discuss a detailed work plan 
that Includes activities, time lines and the names of the parties responsible 
for each activity. Once this document has been agreed to. It can serve as the 
agenda for each meeting. A clear work plan helps ensure that discussion 
remains focused and also aids In keeping the project on track. While It Is 
somewhat time-consuming to prepare, the Initial time taken can prove to be an 
Invaluable time management tool In the future. However, It serves no purpose 
whatsoever If there Is not "buy-In" from all collaborators at the outset of a 
project. There should be an understanding that the document can be amended If 
circumstances so warrant. 
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Final ly. we recommend that one or more people on an advisory committee 
have planning, and not program Implementation, as their primary 
responsibility. The objectivity brought by "planners-only* helps keep the 
group's focus on the overall goal rather than on Individual program elements. 
Having no vested Interest In a program, these Individuals can also serve as 
effective monitors as the project progresses. 



TRAINING INTAKE WORKERS AND EMPLOYMENT COUNSELORS 

In this "Information overload" era. It should come as no surprise that 
even the best workers are not aware of all the resources available to their 
clients; this is particularly true of those new to the Job. For that reason 
an Important objective of this grant was to provide training on illiteracy and 
the free education programs available to clients. While the initial objective 
of this grant was to train approximately 100 professionals representing 
J.T.P.A., Human Services and OSES agencies, it quickly became apparent that 
far more than 100 required infonnation. Thus, by the project's conclusion, at 
least 400 had participated in a 90-m1nute training session. 

During the training process several things became apparent that led us 
to the following recommendations. First, it should not be assumed that those 
working with clients have the information required to offer the client the 
full array of services needed. Sessions on community resources should be an 
integral part of both worker orientation and in-service training. Moreover, 
these sessions should be offered on a periodic basis so that changes in the 
service system can be made clear to workers. We found these sessions to be of 
such value that we plan to continue to offer them in the future. 

Second, we recommend that professionals working with clients be given 
information on how to tactfully and effectively approach a client in need of 
education. Because most people who are functionally Illiterate are 
embarrassed by their lack of skills, we found it helpful to role play 
situations that involved approaching a client on this topic. A worker who 
makes an inappropriate or even unkind remark to a client faces the danger of 
that client being even more "turned off" to education. 

Finally, if there is a literacy hotline in the area, we recommend that 
workers be given that number. In this way a worker must make only one call to 
obtain the necessary Information, rather than calling agency after agency. A 
brochure or even a xeroxed sheet listing the hotline (and/or key literacy 
program) number(s) makes it easier for the worker and more likely that the 
appropriate program will be located for the client. An easy-to-use resource 
directory of literacy services such as the ones published by the Greater 
Cleveland Literacy Coalition and the Ohio Literacy Network can also be quite 
helpful to workers. 
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UPGRADING THE LITERACY TESTING SYSTEM 

An Initial objective of the grant was to upgrade the County J.T.P.A. 
testing system so that test results In reading and math would be more 
meaningful with regard to client placement. However, with the advent of the 
pilot Fair Work Program and later the JOBS Program, It quickly became clear 
that It would be exceedingly practical to have as many agencies as possible 
using a common testing tool. Because clients tend to make use of several 
agencies within the overall service system, it makes sense for all components 
of that system to use the same test. By so doing, the client is subjected to 
only one testing situation; moreover, testing costs to the overall system are 
greatly reduced. 

Our experiences in the area of testing have led us to make several 
recommendations that we hope will prove helpful. First, the use of a coninon 
test proved to be fairly successful and we suggest, particularly In light of 
the JOBS Program, that every effort be made to implement this approach. In 
our case, the agencies that agreed to use the same test were: the city and 
county J.T.P.A. Learning Centers; the Department of Human Services; the County 
Consortium of ABE Programs; and OBES. Others Implementing this approach may 
want to include additional agencies, particularly if those agencies are 
Involved In the client Intake process. 

The second recommendation we make Is that groups not wait until the 
"perfect test" Is found. Lengthy discussion and experimentation led us to 
realize that, at least at this time, there Is no such thing. The objective 
should be to find a test that's the most acceptable to all parties Involved. 
In our situation, agencies elected to use the WRAT math test and 
Gates-McGinitie reading test at the point of intake. Several agencies decided 
to do additional diagnostic testing when a client registered in their program; 
as examples, writing samples were often examined and, when appropriate, the 
practice 6.E.D. test was administered. 

Third, decisions must be made with regard to "passing levels'* on the 
test(s) in those situations where a diploma or G.E.D. is not required, but 
rather the options are to place a client in an educational or vocational 
class. In our case, it was agreed that any client who scored below the sixth 
level In math or the eighth in reading must be enrolled In educational 
classes, unless an exceptional situation warrants a waiver. It should be 
noted that we have often talked about raising the "passing grade" levels, and 
this issue is still under discussion. 

Along with establishing testing criteria, a clearly defined referral 

process should also be developed. With regard to referral, worker knowledge 

of resources again plays an important role, as it Is at this point that 
appropriate client referrals must be made. 
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A fourth recommendation Is that any worker Involved In testing should be 
given training by a professional competent In the area of test 
administration. This training should, of course, be offered periodically for 
new workers. We found two useful training techniques that others may want to 
employ. First, we wrote and distributed a short list of guidelines for test 
administration and client referral; this gave workers something "handy" to 
refer to If they had questions. Second, part of the training Included 
trainees actually taking the tests; this was done to sensitize test 
administrators to the stress and anxiety experienced by clients. 

Fifth, we recommend that a client tracking process be developed to 
monitor the testing and referral system. In our case, we established a 
procedure that called for test results being entered Into the computer as part 
of the client record. Each month a report Is generated on all new clients who 
scored below passing levels; the computer also "kicks out" names of clients 
for whom no test scores have been entered. Follow-up takes place to ensure 
that clients are appropriately enrolled In education classes. 

Finally, for those who have not already done so, we recommend a 
concerted effort to expand and strengthen programs for clients functioning at 
low levels of literacy. Test results, particularly of JOBS clients, has showTi 
us that programs for clients at this level are becoming an Increasing 
necessity. 



DEVELOPING A RECRUITMENT AND REFERRAL SYSTEM 

Another objective of the grant was to develop a recruitment and referral 
system that focused on those functioning at the lower end of the literacy 
continuum and, thus, traditionally considered "hard to serve." However, with 
the advent of first the pilot Fair Work Program and shortly thereafter the 
JOBS Program, recruitment of this population essentially became a moot point. 
While we originally hoped to recruit 40 people 1n this category, at the 
conclusion of the grant we had recruited and served 69, and more were 
regularly entering the program. We were. In fact, obliged during the course 
of the grant to obtain additional classroom space. 

Thus, with regard to this objective our key emphasis was on the referral 
process, both at the level of the individual worker and at the broader 
systemic level. 

We have several recommendations with regard to referral, many of which 
are discussed in other sections of this report. However, a few additional 
suggestions should be mentioned at this point. 
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First, we observed that the type and quality of orientation given by the 
worker to a client prior to placement seemed to affect the client's attitude 
and behavior when he/she arrived at the educational program. Ue suggest, 
therefore, that workers not only give clients Information on the program and 
Its sanctions, but also that a discussion occur on what the client can expect 
to encounter In an educational program: the educational program can and should 
supplement this with an on-site orientation session. The Importance of 
orientation was brought home most clearly during the pilot Fair Work Program. 
Clients In this program were given an orientation of several weeks that 
focused on such Important Issues as self-esteem, behavior management, 
problem-solving and expectations; these clients, as a group ana In the main, 

appeared to be the most positive about the educational process. 
Unfortunately, this type of In-depth orientation and training Is expensive and 
probably not affordable when large numbers of clients are Involved. 

Our second recommendation Is an obvious one, but It must be said: a 
forum should be established that promotes communication and established links 
among all aoencles Involved with clients. All too often, misunderstandings 
' and poor client services result from lack of communication. "Time out" 
meetings should be scheduled to work through broader Issues pertaining to 
services and Inter-agency links. It was our opinion that the successful links 
we established (e.g., the "flow" of clients from the Department of Human 
Services to the County's J.T.P.A. Learning Center) were both due to and 
dependent on our commitment to "time out" communications sessions. 



DEVELOPING BASIC SKILLS TRAINING 

Another objective of this grant was to develop classroom training 
programs at the 4th to 8th levels In writing and math, while maintaining the 
G.E.O. program already In operation. This objective was established because 
of our assumption (which proved to be correct) that the client typically 
described as "hard to serve" would most likely be functioning at the lower end 
of the literacy continuum. 

The curricula developed for these basic skills classses, which are 
running on a year-round basis, are available through the Cuyahoga County 
Learning Center, as are the very positive evaluations of the programs. For 
the purposes of this report, however, here I will focus not on content, but 
rather on the process and experiences that led us to a series of suggestions 
for others. 

First, we found that even In the relatively limited spectrum of the 4th 
to 8th levels, it is best to subdivide students Into separate and distinct 
classes by levels of ability. Mixing students at the 4th and 8th levels 
appeared to hamper both. For that reason a multi-level approach was 
developed, and clients progressed through each level as their basic skills 
increased. 
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Second, we learned that classroom-only education In writing and math did 
not always suffice for clients starting at lower levels, despite the fact that 
writing was taught In the context of social studies and required readings. We 
learned over time that a "reading-only" program had to be established for 
clients at too low of a level of literacy to hold their own In the "easiest" 
(I.e., first level) classroom program, and we are now working at developing 
such a program that will use "real" life and Job materials. It also cppears 
that tutors will be required at this level for supplementary asslsta.-^c^ 

Third, we observed that computer-asslsted-lnstructlon (c-a-1) seems to 
have value for clients functioning at lower levels, but primarily only when It 
Is used to develop "rote" skills. While clients at the 6.E.D. level seemed to 
find c-a-1 both helpful and acceptable, the lack of human Interaction and 
guidance did not seem to suit clients at lower levels. Part of the reaction 
we encountered might have been a result of the software used; we are now 
exploring other software packages. 

Fourth, we quickly learned that It was necessary to develop clearly 
stated guidelines on attendance and classroom behavior. We found that the 
guidelines not only clarified expectations, but also initiated an 
understanding of the relationship between "rules" and getting and holding a 
Job. We observed, to no one's surprise, that explaining wh^ the rules were in 
effect helped gain adherence to them. 

Fifth, with regard to client orientation, we learned that a certain 
degree of "selling" was called for. While no false promises were made, 
benefits were emphasized, as were client rights and responsibilities. It was 
made clear from the outset that while sanctions would be applied if necessary, 
the program would make every effort to provide other types of motivation. 

Sixth, we became aware that, particularly with this client population, 
some non- traditional teaching skills were necessary. While it Is perhaps 
overstating the obvious to say that clients often have personal problems, what 
Is less clear is the degree to which the teacher can and should become 
Involved in those difficulties. Here, the role of the case manager comes Into 
play, and we learned that the most effective workers remained accessible to 
the client and teacher, even though the client was, at least temporarily, 
"placed." Regardless of the worker's Involvement, however, it was clear that 
the teachers weren't "Just teaching;" the need for teachers to do "social 
work" was present in almost every learning situation. 

We learned that teachers should also participate in an orientation 
program that should include learning to interact effectively with the 
"non-traditional student" and information on the program in which the client 
Is involved and support services available to that client. We also learned 
that teachers as well as students need periodic "pep talks." 

Since clients with whom we worked were participating on a voluntary 
basis, we had limited experience with those mandated to attend and 
subsequently exhibiting overt resistance to the program. In the next phase of 
our collaborative efforts we will be working to motivate and teach those 
mandated to participate in education. 
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THE COLUBORATORS 

Members of the project's Advisory Committee were: Ms. Nancy Cronin, 
Cuyahoga County Department of Development; Ms. Phyllis Osol Dykes, Greater 
Cleveland Literacy Coalition; Mr. Dean Fangman, Cuyahoga County Department of 
Development, Division of Employment and Training; Ms. Pat Heller, Cuyahoga 
County Department of Development, Learning Center; Mr. George Hill, Cuyahoga 
County Department of Development, Division of Employment and Training; Mr. Dan 
Koncos, Ohio Bureau of Employment Services; Ms. Jayne Kuhnen, Cuyahoga County 
Department of Human Services; Ms. Carolyn Milter, Cuyahoga County Department 
of Development; Mr. Larry Robinson, Cuyahoga County Department of Development, 
Division of Employment and Training; Ms. Catherine Thomas, Cleveland Heights - 
University Heights Adult Basic Education Program; and Ms. Maureen Weigand, 
Cuyahoga County Department of Human Services. 
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